Understanding and Interpreting Regression Parameter Estimates in Given Contexts: A Monte Carlo Study of Characteristics of Regression and Structual Coefficients, Effect Size R Squared and Significance Level of Predictors

نویسندگان

  • Ying Hong
  • Ying Hong Jiang
  • Philip L. Smith
چکیده

This Monte Carlo study explored relationships among standard and unstandardized regression coefficients, structural coefficients, multiple R_ squared, and significance level of predictors for a variety of linear regression scenarios. Ten regression models with three predictors were included, and four conditions were varied that were expected to have influences on the relationship under investigation: (1) magnitude of direct effect from predictors to the outcome variable; (2) colinearity; (3) sample sizes; and (4) model misspecification. Results show that regression parameter estimates behave differently under influences of strength of direct effect of predictors, sample size, and collinearity conditions. Although all the parameter estimates are sensitive to variations of strengths of predictors' effects, some parameter estimates are vulnerable to variations of sample size and collinearity conditions. Standard regression coefficients Beta exhibit the best performance under these specific conditions. Structural coefficients, on the other hand, show relatively less sensitivity to variations of strength of direct effect of predictors, and are very vulnerable to collinearity conditions. R_Squared issensitive to strength of direct effect of predictors; it is vulnerable somewhat to collinearity conditions. Significance level of predictors is most sensitive to variations of strength of direct effect of predictors than structural coefficients; meanwhile,'it is largely vulnerable to sample size and somewhat vulnerable to collinearity conditions. One appendix contains 10 models, and the other contains the study tables. (Contains 10 figures (models), 17 tables, and 6 references.) (Author/SLD) Reproductions supplied by EDRS are the best that can be made from the original document. PERMISSION TO REPRODUCE AND DISSEMINATE THIS MATERIAL HAS BEEN GRANTED BY TO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) U.S. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC) This document has been reproduced as received from the person or organization originating it. 1:1 Minor changes have been made to improve reproduction quality. e Points of view or opinions stated in this document do not necessarily represent official OERI position or policy. Understanding and Interpreting Regression Parameter Estimates in Given Contexts: A Monte Carlo Study of Characteristics of Regression and Structual Coefficients, Effect Size R Squared and Significance Level of Predictors Ying Hong Jiang, Azusa Pacific University Philip L. Smith, University of Wisconsin-Milwaukee Paper Presented at American Educational Research Association Annual Meeting, 2002, New Orleans 2 3337 COPY AVAIILA 1

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Investigating bias in squared regression structure coefficients

The importance of structure coefficients and analogs of regression weights for analysis within the general linear model (GLM) has been well-documented. The purpose of this study was to investigate bias in squared structure coefficients in the context of multiple regression and to determine if a formula that had been shown to correct for bias in squared Pearson correlation coefficients and coeff...

متن کامل

Positive-Shrinkage and Pretest Estimation in Multiple Regression: A Monte Carlo Study with Applications

Consider a problem of predicting a response variable using a set of covariates in a linear regression model. If it is a priori known or suspected that a subset of the covariates do not significantly contribute to the overall fit of the model, a restricted model that excludes these covariates, may be sufficient. If, on the other hand, the subset provides useful information, shrinkage meth...

متن کامل

Comparison of Maximum Likelihood Estimation and Bayesian with Generalized Gibbs Sampling for Ordinal Regression Analysis of Ovarian Hyperstimulation Syndrome

Background and Objectives: Analysis of ordinal data outcomes could lead to bias estimates and large variance in sparse one. The objective of this study is to compare parameter estimates of an ordinal regression model under maximum likelihood and Bayesian framework with generalized Gibbs sampling. The models were used to analyze ovarian hyperstimulation syndrome data.   Methods: This study use...

متن کامل

Comparison of time to the event and nonlinear regression models in the analysis of germination data

Extended abstract   Introduction: Numerous studies are being carried out to reveal the effects of different treatments on the germination of seeds from various plants. The most commonly used method of analysis is the nonlinear regression which estimates germination parameters. Although the nonlinear regression has been performed based on different models, some serious problems in its structure...

متن کامل

Classical and Bayesian Inference in Two Parameter Exponential Distribution with Randomly Censored Data

Abstract. This paper deals with the classical and Bayesian estimation for two parameter exponential distribution having scale and location parameters with randomly censored data. The censoring time is also assumed to follow a two parameter exponential distribution with different scale but same location parameter. The main stress is on the location parameter in this paper. This parameter has not...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012